Description

The structured_output implementation in the Bedrock and Anthropic model provider call the model with a hard coded tool_choice: auto. The auto option lets the model itself decides whether to use a tool and use which tool. Instead, we want to make sure the tool is used in structured_output function for the sake of performance.

Therefore, following changes are made:

1. Add a new parameter to Model.stream() that takes in the toolChoice, defaulting to auto;
2. Plumb it through so that each provider uses it (if they support it)
3. For providers that use tool calling for structured_output (Bedrock and Anthropic), pass toolChoice=any when calling stream()
4. Add unit tests

Related Issues

#256

Documentation PR

N/A

Type of Change

New feature

Testing

How have you tested the change? Verify that the changes do not break functionality or introduce warnings in consuming repositories: agents-docs, agents-tools, agents-cli

• I ran hatch run prepare

Checklist

• I have read the CONTRIBUTING document
• I have added any necessary tests that prove my fix is effective or my feature works
• I have updated the documentation accordingly
• I have added an appropriate example to the documentation to outline the feature, or no new docs are needed
• My changes generate no new warnings
• Any dependent changes have been merged and published

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.